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ABSTRACT 

General information on the studies currently underway 
by the Southwestern Cooperative Educational Laboratory (SECEL) is 
presented in this report. Module A is concerned with investigating 
the relationships between a variety of cultural -psychological factors 
and language development in grade 1. Testing and heme interviews play 
a major part in this investigation. The purpose of Module B is to 
investigate the effects of systematic variation of several parameters 
in the classroom. Module C is concerned with field tryouts of oral 
language materials for culturally diverse children. Module D is 
concerned with entry skill development in the area of speech 
elicitation procedures. Copies of Health, Education, and Welfare 
Department forms and the instruments used are included for each 
project in progress. It is noted that some reorganization, shifting, 
and refocusing are taking place within the Laboratory. The 
operational structure is moving to a Task Group structure rather than 
a Task Force structure. The new emphasis is on small task groups. A 
newly-formed body called the Plans, Review, and Evaluation Panel is 
responsible for the review, evaluation, and directive function. 
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CURRENT STATUS^OF LABORATORY STUDIES 
Paul Liberty, Robert Reeback, Richard Thiel ^ 

\ c lU 

The SWCEL Annual Report, September 1, 1967, outlines the general 
evaluation model that guides Laboratory research avid specifies the studies in 




the various modules. The present paper is designed to supplement and update 



the statement in the Annual Report by providing general information on the 
studies currently underway. A significant development in the Laboratory has 
been the streamlining of the organization into two Task Force groups. Task 
Force I is composed of Modules A and B, which formerly were called I and III. 
Task Force II comprises Modules C and D, which previously were named II and 



IV. 



TASK FORCE I 

Module A 

Module A is concerned with investigating the relationships between a 
variety of cultural-psychological factors and language development in the 
first grade. Specifically, the major study in this Module is entitled, 

"Socio- Psychological Variables Relating to Language Skill Development Among 
Culturally-Diverse First Grade Students." The research design calls for 65 
Navajo, 65 Pueblo, and 65 rural Spanish-American first grade students. The 
communities were contacted beginning in August and contracts with various com- 
munity educational agencies were finalized during September. These agencies 
approved the instruments also. A number of consultants, notably Dr. Lloyd Dunn, 
and the Laboratory staff identified a number of anthropological, sociological, 
and psychological variables and instruments to be used in the investigation. 
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Module A-continued 




The major input here was from Richard Thiel, Malcolm Garber, and Paul Liberty 
of the SWCEL staff. Two anthropologists, Dr. Stanley Newman of the University 
of New Mexico and Dr. Henry Burger of, SWCEL contributed information on cultural 
relevance of concepts and scale items. 

Very few instruments were found to exist for elementary school child- 
ren, particularly for first grade pupils. Our initial tryout of instruments 
indicated that many items in the Student Questionnaire were too difficult 
for cultural ly-diverse first graders. Several kindergarten classes provided 
the information on which our decision was made to considerably modify and 
rewrite items from such scales as Bialer's Locus of Control, Sarason's School 
and Test Anxiety Scale, and items dealing with preference for immediate vs. 
delayed rewards. Additionally, a preliminary investigation among Indian 
youngsters ruled out a number of items that did not appear to be comprehended 
by these youngsters. In some instances, serious discussion arose on whether 
items should be excluded because of cultural irrelevance or whether the items 
should be retained because of the useful cross-cultural information that might 
result. In general, if the item or concept was one that our information in- 
dicated Indian youngsters could comprehend, the item was retained in order to 
make cross-cultural comparisons. A basic premise in making this kind of deter- 
mination was that our investigation was primarily an empirical investigation, 
and that, therefore, we needed to obtain a wide-range of information to update 
the literature in the field. We realized too that considerable acculturation 
has taken place among the culturally-diverse groups in the region served by 
the Laboratory, and it was necessary to assess the degree and areas of that 
acculturation. 
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Module A-continued 

It should be pointed out here also that we expected in this first 
exploratory investigation to obtain a great deal of information about instrumenta- 
tion with culturally-diverse groups, particularly Indian youngsters. Although 
our pre-screening of items was quite comprehensive, the reports of testers and 
interviewers will be closely scrutinized to determine better methods of informa- 
tion acquisition. Instruments are not numerous for first grade students and 
are even less plentiful for children from culturally-diverse groups. Consequently, 
a considerable emphasis will be made to develop culturally appropriate instruments 
for use with culturally-diverse youngsters. (The major consideration is focused 
upon Indian youngsters because, by and large, Spanish-speaking youngsters had much 
less difficulty with items selected.) A brief description of the study and the 
instruments utilized is presented in Appendix A. Copies of the instruments can 
be obtained from Mr. Thiel or Dr. Liberty. 

To accomplish the testing and home interviewing, a group of people primarily 
with advanced degrees were selected. In the team of eight, two staff members 
with B.A. Degrees were utilized but both had research training and/or inter- 
viewing experience at the university level. Four days were allotted to training. 
This training involved actual experience with testing and interviewing, observing 
video tapes of particular test administration, analyzing, rewriting or discard- 
ing items which proved to be too difficult. Individuals who administered the 
Illinois Test of Psycholinguistic Ability were given instruction and training by 
Dr. Lloyd Dunn and his wife. Data collection proceeded very smoothly due un- 
doubtedly to the training sessions and the excellent field contact work of Dr. 

John Seaberg of SWCEL. 
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Module A-continued 

The testing began during October and will be completed very early in 
November. Testing time for each subject child, including home interview with 
the child's mother, required approximately 4% hours 4 

Some problems obtaining home interviews had been encountered among Navajo 
mothers in Sanders, Arizona. Resentment toward Anglos is responsible primarly, 
although community factionalization is indicated also. Apparently, major re- 
sentment is based upon the lack of a Navajo representative on the school board 
in that area and also the perceived differential treatment of Anglo children 
in school bus service. 

The major problem immediately ahead is the data analysis phase. An 
early study relates cultural and other factors to learning styles as measured 
by the ITPA (on pretest). At the same time, innumerable item analyses must 
be performed to determine inter-item reliability and other procedures necessary 
£or scale construction and revision. Innumerable and continuing computer 
analyses must be performed to accomplish full use of the wealth of data 
collected. The need thus is for a computer programming specialist to establish 
a Laboratory computer program library and to be responsible, under the Research 
Coordinator, for handling and transmission of data to computer installations, and 
of course, to accomplish the desired analyses. The acquisition of this essential 
person is predicated upon funding beyond the Budget A level. 
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to :See below 



oate; October 19, 1967 



rnoM : Herbert S. Conrad, Chairman 1 '$^? 
Internal Clearance Committee ' 



subject. Clearance of 11 data -gathering, instruments designed for use in the extra- 
mural research project entitled "SOCIO-PSYCKOLOGICAL VARIABLES RELATING 
TO LANGUAGE SKILL DEVELOPMENT AMONG CULTUKALLY-DIVERSE FIRST-GRADE STUDENTS " 
Southwestern Cooperative Educational Laboratory, Inc., Albuquerque, New 
Mexico. (Contract No. CEC-4-7-G62S27-3078.) 



The purpose of this study is to investigate the influence of various 
sociopsychological variables on language skill development of Spanich- 
American and Navaho first-grade pupils. 

The following 11 data-gathering instruments have been submitted for 
clearance prior to use in the abovenamad project: 

1. The Illinois Test of Psycholinguistic Ability. 45 min., pretest 
and posttest. 

2. Peabody Picture Vocabulary Test. 15 min., pretest. 

3. Parent -Interview. 30 min., pretest. 

4. Cultural Information Index - Form A. 45 min. , pretest. 

5. Student Questionnaire. 10 min., pretest. 

6. Mother Que stionnaire. 30 min., pretest. 

7. Child Interview Questionnaire and Tests Information Sheets. 

30n min. , pretest- 

8. Caldwell Preschool Inventory., 30 min., pretest and posttest. 

9. California Achievement Test (CAT), 1957 edition, 1963 norms, 

90 min. , posttest. 

10. Beginning Reading Test, Revised Experimental Edition, Form AB and 

Form BA. 15 min. , posttest. 

11. Visual Memory for Designs. 10 min., pretest (20 questions). 

Samples of respondents, considered to be reasonably typical of Navaho 
Indians, Pueblo Indians, and Cpx-ii Spanish-Amcricans of lower-class back- 
ground in the seg region served by the Laboratory (with the exception of 
Oklahonvx) will participate. These will include a total of 205 firsC -graders 
and their mothers. GO TO NEXT PAGE 

Copit-s to: 

--■yPtin. I nv* gat or Mr. McCann Mr. Hochstein Reading File 

Xippnes/Parmeter Wr. Boyaa Mr. Cook BSCCM2AD: lc 
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Further information concerning data-gathering instruments , as well 
as a detailed statement of the nature, and the number of respondents , ace 
available in the Standard Form 83, "Supporting Statement for Extramural 
Research Projects , " 

"To insure confidentiality of data and a valid test administration, 
specially-trained test administrators will be used. . .Names of respondents 
ore necessary to accomplish matching of child test responses and ©other 
responses to home interview instruments. Respondent numbers will replace 
this form of identification as data reduction commences. Because the data 
collected will comprise a vital pool of information for the Laboratory ef- 
fort, it i 3 expected that the basic data will be retained for 1-2 years 
as Laboratory researchers *tnilk* the data.' The source data will be availa- 
ble to research personnel only." 

The data-gathcring instruments are hereby cleared for use in this study. 
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October 11, 1967 

h 



Mr. Adrian Parmeter, Program Coordinator 
Division of Educational Laboratories 
U.S. Office of Education 
400 Maryland, S.W. 

Washington, D.C. 20202 

Dear Mr. Parmeter: 

Enclosed are six copies of a request tor "Review of Data Gathering 
Instruments." The instruments listed will be used in a study of the 
"Socio-Ps ychological Variables Relating to Language Skill Development 
among Culturally-Diverse First Grade Students." This study is being 
conducted by Module I of our Laboratory. Details of this study are 
provided on the attached supporting statement. 

Since testing is scheduled to begin next week, please notify us by 
telephone of clearance action. 

Thank you again for your consideration. 

Sincerely yours, 



Paul G. Liberty, Jr. 
Research Coordinator 

PGL : lc 




SI-S3 SUPPORTING STATEMENT FOR EXTRAMURAL RESEARCH PROJECTS 



p roject retie; Southwes earn Cooperative Educational Laboratory, Module I Socia’ and 
Psychological Factors Influencing Learning in Culturally-Divers^ Groups 
investigators: Richard Thiel and Malcolm Garber. Study Title: Socio-Psycholo^ical 

'“ labl “ Relstin « to Skill Developmcnc anon S Cultur.Uy-Div.rs. Fir s t*£°d<, Students 

1. NAME OF CONTRACTOR CONDUCTING PROJEC T Southwestern -Coonutstiu. 

— Educational Lab oratory, Inc. . Albuouerquc, New Mexico 

2. OE CONTRACT NUMBER OEC -4-7 -062827 -3078 



Dated: From 3/1/6 7 



T o 5/31/68 



o. NAME OF PROGRAM AND PUBLIC LAW UNDER WHICH CONTRACT WAS AWARDED 
— Regional Educational Laboratories Program., P. L. 89-10, Title IV 

4 ‘ FISLD READERS, OR OTHER GROUPS) THAT 

RE^aMMa,NDi,D APPROVAL FOR SUPPORT OF THIS RESEARCH PROJECT 

^Southwestern Cooperative Educational Laboratory, Inc., Albuouereu*. TvJ.-w Mexico 

** T JS S ?ROJZCT been REVIEWED AND APPROVED WITH QUALIFICATIONS 
THE BUREAU STATISTICAL REVIEW PANEL, ON (Date)___ 

5. EXPLAIN THE RELATIONSHIP OF THE DATA GATHERING INSTRUMENT IN 
ACCOMPLISHING THE OBJECTIVES OF THE PROJECT 
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a - General natur e and objectives of the study: The purpose of this study is co 
investigate tne inriuende of various socio-psychological variables on language skill 
development of Spamsh-American and Navaho first grade pupils. 

Brier iy state; this study attempts to identify student and background (cultural) 
variables that are related to language skill development of Spanish-American and Navaho 
iir^t-grade pupils. Botn individual children and their mothers will be tested and/or 
interviewed. Various analyses (factor analysis, analyses of variance and covariance, 

an multiple regression analyses) will be performed t«. determine culturally-signif icant ’ 
variables. . ° 

b. Instruments to be applied: The development of language skills depends upon many 

antnropologicai sociological, and psychological variables. Motivation, learning style, 
degree Oa. assimilaticfn (cultural), values, certain kinds of school readiness skills 
home environment and demographic variables all combine to influence language develop- 
ment or tne cultural ly-aiverse child. However, these factors may have different 

varSsi»t ff K a8 / irfer *u C Cultura * e rou P s - The purpose of the study is to isolate those 
/ariables tnat contribute significantly to language skill development of three 

cu turally-divergent groups. Results of the present study 11 provide (continued next 
ESTIMATE^-/ NUMBER OF MANHOURS REQUIRED BY ONE RESPONDENT TO 
COMPLETE QUESTIONNAIRE 
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ESTIMATED TOTAL COST OF SURVEY $ 13,000 

INCLUDING; — 

a. Costs of Planning and Organizing- the Survey 

c! and Sample Mai:ucnar.ce 



SF-S3 



Item 5. b. continued. 

useful information toward the development of programs to facilitate language 
learning of culture 1 ly-diverse first-grade bilingual students. The rollowing 
variables and instruments were selected for investigation: 



Variables 


Measures 


1. Learning Style 


The Illinois Test of Psycholinguist ic 
Ability. Test measures various kinds 
of sensor^ encoding and decoding (how 
individual takes in information from 
^environment and how individual incor- 
porates information and responds.) 

See Buros 1 Sixth Handbook for more 
details, no. 549. (Copy not enclosed.) 
45 minutes Pretest and Post-test. 


2. Vocabulary Ability 


Peabody Picture Vocabulary Test. For 
details see Buros 1 Sixth Mental Measure- 
ments Yearbook, no. 530. (Copy not 
enclosed.) 15 minutes Pretest. 


3. Family Interaction 


Parent Interview Form, Richard M. Wolf, 
author. (Copies enclosed.) 30 minutes 
Pretest . 


4. Cultural Information 


Cultural Information Index - Form A. 
(Copies enclosed.) 45 minutes Pretest. 


5. Pupil Motivation and Self 
Concept 


Student Questionnaire, including items 
relating to preference for immediate 
vs. delayed reward, self-concept, posi- 
tion relative to parents, test-school 
affect, aco # uies cence , and locus of control 
(Copies enclosed.) 10 minutes, Pretest. 


6. Entry Skills (readiness for 
school and reading) 


SWCEL Questionnaires : (1) For Mother 

comments about child; (-2) For Child 
comments about Self. (Copies enclosed.) 
30 minutes each Pretest. 


7. Caldwell Pre-School Inventory 


A measure of achievement in areas 
regarded as relating to success in 
school. The Inventory is a brief 
assessment procedure designed for indi- 
vidual use with children in tnrea-to-s i:< 
age range. Test was designed for use 
in Headstart programs. Copyrighted 1967, 
Educational Testing Service. Yields 
s cores on four dimensions: Personal- 

Social Respons iveness , Associate Voca- 
bulary, Concept Activation, and Numerical 
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Item 5, b. continued. 



Sensory. (Copies ox test items 
enclosed.) 30 minutes Pretest and 
Post-tes t. 



S. California Achievement Test 
(CAT, 1957), 1957 edition, 
1963 norms . 



Test yields separate scores for 
Reading, Arithmetic, and English. 

90 minutes Post-test. (Hot enclosed) 



9. Beginning Reading Test 



10. Klaus* Visual Memory for 
Designs 



Authors: Richard W. Woodcock and 

Philip Pfd'st, George Peabody Cp liege 
for Teachers. , Contains sections on 
Letter Recognition; Word Recognition 
and Sentence Reading. 15 minutes 
Post-test. (Copies enclosed--2 forms.) 

A new test based on findings that 
poor visual memory for designs and 
reading difficulty seem to go together 
later in school. Child is shown and 
design must pick out design on another 
card of six designs. 20 questions 
10 minutes. Pretest. 



The above instruments have been explained to various educational agencies 
within the communities where testing will take place. Questionna ires which ask 
about home information from mothers have been given initial review and approval 
by educational councils of Spanish-Amer lean schools and communities involved 
and by educational committees of Indian tribal councils. Some shifting of 
instruments between pm and post-test conditions may occur after trial testing 
results become available. A decision could also be made to drop an instrument 
which is found to be inappropriate for use with our populations or which yields 
too much overlap with other instruments or parts of instruments. Pretesting 
will be accomplished during October and post-testing during May, 1968. 



c. * Respondents and Sampling : 



In the present study an effort was made to obtain samples of respondents 
considered to be reasonably typical of Navaho Indians, Pueblo Indians, and 
Soanish-Americans of lower-class background in the region served by the Laboratory, 
with the exception of Oklahoma. Accordingly, the following numbers cf first- 
grade pupils in the areas listed were selected: 



(1) Navaho firs t-graders at Sanders, Arizona - N = 65. 

(2) Pueblo Indian f irst-graaers : 

(a) Santo Domingo Pueblo s N * 22 
*(b) Cochiti Pueblo - N = 14 
*(c) Sandia Pueblo - N * 6 
*(d) Santana Pueblo - N = 11 

(e) San Felipe Pueblo * K * 23 (Bureau of Indian Affairs School) 

(3) Spanish-American f irst-graders at Roosevelt School, Bernalillo, New 

Mexico N = 65. 



Totals for asterisked (*) schools indicate the total number of such students . 
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Item 5. b, continued. 

Children at Sandin and Santana Pueblos attend the Roosevelt School 
Bernalillo* In other instances, & random selection of subjects was 
made. Approximately sixty- five subjects in each sample was considered 
the maximum affordable. Subjects chosen for study could not be repeaters 
and handicapped cases and must be minimally bilingual (i.e. have some know- 
ledge of the English language). 

Cooperating schools and cotrnun itees were obtained through field contact 
efforts of Laboratory personnel with educational leaders of community. 

These community educational agencies have prepared the way for entrance into 
homes in the various communitecs for*. the purpose of obtaining home inter- 
view data . * * 



Testing of children is on an individual basis* and is accomplished during 
school hours. Interviewers will conduct interviews with mothers of children 
tested after children have been tested. Estimated time spent by a child 
in pretest is 140 minutes; estimated time spent by child in post-test is 
180 minutes. Each mother interview will require about 105 minutes. 



Copies of a. 11 tests or references thereto in the case of cognitive instru- 
ments of the standardized variety are supplied, with the exception of the 
Klaus* Visual Memory for Designs Test (test .number 10). Copies of a brief 
description of this test are supplied, however. 

d. Data Analysis : Data ana lys is procedures are indicated under (a) 

"General Nature and Objectives of Study. 11 Factor analyses will be 
performed to reduce the number of variables to be considered in subse- 
quent analyses. Multiple regression techniques will be employed to 
discover best possible prediction of language arts dependent variables. 

It is anticipated that a number of between group comparisons will bd pvifrG 
Also, data analysis will be. extended to apply to several tangential 
investigation, namely sociological correlates of 1TPA (Illinois Test of 
Psycho) inguis tic Ability) performance and cultural background differences 
among three groups in study. 

The major immediate emphasis is the identification of various variables 
believed to be related to language skills development in the various 
groups. The findings will be subjected to a replication study and then 
incorporated into the curriculum development programs and teacher train- 
ing programs of other modules within the Laboratory. 



e. Confidentiality : To insure confidentiality of data and a valid test 

administration, specially-trained, test administrators will be used. 

These examiners and home interviewers have been given a 4-day training 
program. Names oi respondents are necessary to accomplish matching 
of child test responses and mother responses to home interview instru- 
ments, Respondent numbers will replace this form of identification as 
data reduction commences. Because the data collected will comprise a 
vital pool of information for the Laboratory effort, it is expected that 
the basic data will be retained for 1-2. years as Laboratory researchers 
"milk" the data. The iburce data will be available to research personnel 
only. 
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Item 5. b. continued. 

Participation of school personnel in this study is based upon a data- 
s ha ring operation. Cognitive test results of pupils tested will be 
made available to schools for use in pupil assistance programs. Home 
interview data is, of course, treated as being highly confidential 
and will be available to authorized Laboratory personnel only. 

6. ESTIMATED NUMBER OF MANHOURS REQUIRED BY ONE RESPONDENT 70 COMPLETE 
INSTRUMENTS : 



Time for each child in pretest - 2 hours, 20^minutes 
Time for each child in post-tfest - 3 hours 
Mother interview in home - 1 hour, 45 minutes 

7. ESTIMATED COST OF STUDY: $12,000 
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Module B 

The purpose of this module is to investigate the effects of systematic 
variation of several parameters in the classroom. Specific parameters now 
under study are the nature of reward .and the delay of reward. Traditionally, 
verbal praise has been the major source of reinforcement in the classroom. 

However, this reinforcement is momentary in nature and may not serve as an effect- 
ive incentive for either short or long-term goals. Perhaps, a point system 
where correct behaviors of individuals in a class are rewarded by points and 
these are cumulated for the class as a whole may better motivate the performance 
of desired behaviors. In the present study, the conventional mode of verbally 
reinforcing appropriate behaviors will be compared with a point system where the 
class as a whole accumulates points toward some maximum number, at which time 
some tangible reward will be awarded. 

Also, although research on delay of reward indicates that immediate reward 
is more effective in establishing desired behavior, it seems reasonable that 
children might work as well for delayed goals than for immediate reward, particularly 
if the delayed reward involves a magnitude sufficient to overcome the effects of 
delay. Thus, delay in goals and magnitudes of reinforcement, as well as verbal 
praise versus point-reward system, will be investigated. 

Eight teachers in the Albuquerque Public School System are involved in 
this research. These teachers initially developed an entire first grade, behavioral 
objectives, curriculum. This curriculum serves as a common base for studying 
the effects of various reinforcement conditions across classrooms and providing 
the built-in evaluation required to assess different teaching strategies. Ac- 
tually, four schools are cooperating in this research project. In addition to 

the verbal praise, immediate reward, and delayed reward conditions, control 
group classrooms outside the experiment proper, are availeble in the schools. 
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Module B- continued 

At the present time, experimental phase two of the study has begun with 
teachers assuming new reinforcement conditions. At the end of the first phase, 
two trained classroom observers, certified teachers,' rated various aspects of the 
classroom situation, pupil behavior, teacher performance, and classroom atmosphere 
A preliminary reliability study indicated a high degree of inter-rater reliabi- 
lity. In addition to classroom observations in twelve experimental and control 
classrooms, small random samples of children were drown from the same classrooms 
to determine children's perception of the reward situation and various kinds 
of affect. The Instruments used, and a sketch of the study, are included in 
Appendix B. The kinds of items in the questionnaire concern the liking for 
school, preference for immediate versus delayed reword, test and school anxiety, 
locus of control, and measure of self-esteem. Thus, to evaluate the effects of 
the study conditions, we have made independent observations of the classrooms 
involved and interviewed children from those classrooms. Observation and in- 
terviewing will be employed in all phases. 

Children had been previously tested with the Goodenough Draw-A-Man Test 
and the Lorge-Thorndike Intelligence Test. The California Achievement Test 
will be administered following the completion of the eighteen-week experimental 
program. This will allow us to determine the achievement levels of classrooms 
under various reinforcement and standard classroom conditions. In terms of 
subsequent studies, this testing will serve as the pretest. It is anticipated 
that the subsequent studies, depending upon level of funding, will incorporate 
a greater number of teachers into the experimental situation to assess their 
preferences for various types of classroom management. This would serve to 
reduce the influence of the Hawthorne effect. 



Alternative studies could involve 



SWCEL 

CURRENT STATUS OF LABOkATORY 
STUDIES/PGLjael, 11/7/6? 

7 . 

U 

Module B-continued 

g individual differential reward conditions where Ind ividual students 

are selected to represent the class and point, are assigned on the basis of levs! 

of knowledge indicated. It is interesting to speculate whether Individual 

excellence, competitiveness, and agresalveness are enhanced by such a procedure 

relative to the situations where the group a, a whole is considered to have 

earned points. Similarly, a study on vicariou. reinforcement could be undertaken 

to assess the degree of learning whan positive and negative models are used 
to represent the class. 

M regard to the study now underway, it is interesting to speculate on 
what happens to student interest and liking for school as they shift between reward 
conditions, for example, from long-term reward to short-term reward, to verba, 
praise. The opening of a new school and the transfer of students provides a 
ting for this study. Also, it will be possible to investigate the 
degree of learning within each of the experimental conditions when additional 
work is done on the behavioral objectives in the curriculum. 

Future work in this module depends on the level of funding to expand the 
Program, the ac,uisitio„ of a computer progras-er type, and considerations on 
whether the program on classroom management should be and/or is ready to be 
exported to other parts of the four-state region. The possibility of operating 
rhis program in Oklahoma has been broached. The major hypothesis of the program 
efforts of this module 1. that certain classroom management practices can be 
employed that yield better management of the claa.room, that produce more posl- 
ave affect on the part of the Individual pupil toward school, himself, and 

learning i„ general, and that in the long ru^ such conditions win be reflected 
in improved academic performance. 
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y PLEASE T"' 

DEPARTMENT OF HEALTH. EDUCAJIOnTaND WELFARE 1 * 
OFFICE OF EDUCATION 

memorandum BUREAU OF RESEARCH 



SMfT TO •• 
INVESTIGATOR^^ 



vo tSee below 



oat«i October 13, ,1967 



FMOM 



•Herbert S. Conrad, 
Internal Clearance 



Chairman 

Committee 




(uwkti C learance of 3 cognitive testa designed for use in the extramural research 
project entitled THE EFFECT OF NATURE OF SELECTED REINFORCING CONDITIONS * 

ON COGNITIVE AND AFFECTIVE CUSSROOM LEARNING." SouthwoS Coop««“ 
»Mo\ ti<mal laboratory, Albuquerque, New Mexico. (Contract No. 0EC-4-7-062827- 

3U/OJ v 



The purpose of this study is "to c investigate the effects of systematic 
variation of several parameters of reinforcement, in classroom situations." 

Three tests of cognitive functions have been submitted for clearance 
prior to use in the abovenamed project, as follows: 

1. California Achievement Test, CAT, 195? edition, 1963 norms (45 min., 
fca to be administered twice, as "pre" and "post").. OR Cooperative 
Primary Tests (battery of 6) (1% hr., to be administered- twice, as 
"pre" and "post"). 

2. Goodenough Draw-A-Man Test. (10 min.) 

3. Lorge- Thorndike Intelligence Test (2 hr. 15 min.) 

Respondents will include approx. 240 first-grade children, primarily 
of uoper-lower or lower-middle class background, about evenly divided 
between Anglo-Americans and Spanish -Americans . The children are from 
£be Albuquerque Public School system. "This population was selected in 
order to reach a relatively disadvantaged group of youngsters while avoid-' 
ing the problems presented by a non-English speaking population." 



’To insure confidentiality of data and a valid test administration, 
an expert test administrator, trained by the Laboratory, will administer 
the tests listed above. School personnel are not entitled to results of 
this testing except in form of class averages. Respondents' numbers will 
replace student identification as data is placed on magnetic Cape for 
data analysis purposes , Test data by student name will be filed and kept 
for a period of about. one year for purposes of within Laboratory research." 



The tests are hereby' cleared 



Copies to: 

Dr. Conrad 
Prin. Inv'gator 

MEW- AT 

(KEY. J.<4) 




Reading File 
Kiss Kippfces 



for use in this study. 




Mr. Cook 



Mr. Hochstein 
HSCONRAD ; lc 



SOUTHWESTERN 

COOPERATIVE EDUCATIONAL LABORATORY, INC 

Arizona • New Mexioo • Oklahoma • West Texas 



J* G. STRATTON, Prtttdtwi 



PAUL V. PETTY, Direct* 



Phone: 277-522' 



117 Richmond,. K,£ Albuquerque, N. M. 87106 




October 4, 1967 



Mr. Adrian Parmeter 

Program Coordinator 

Division of Educational Laboratories 

U. S. Office of Education 

400 Maryland, SW 

Washington, D. C., 20202 

Dear Mr. Parmeter: : 



Please find enclosed six copies of a request for "Review of Data Gathering 
Instruments " The instruments listed will be used in wnJuncJSn ^ * 

the evaluation of student gain' in a study investigating the effect of 
selected reinforcing conditions on cognitive and affective classroom 

supporting ietalU o£ the “ udy • u <’P ll ‘ d »" 'h. sctsched 



Thanks again for your consideration. 




PGL/ael 

2nd: l in 6 copies 
cc: Dr. Herbert's.' Conrad 

Dr. Paul Petty 
Dr. Stanley Caplan 
Mr# Richard Thiel 
Dr. James ‘Moore 



O 
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,$F-83 SUPPORTING STATEMENT TOR 



EXTRAMURAL RESEARCH PROJECTS 



Experimentsi In^es tigsUon^f^lals^om ^ UCational Laboratory, Module III, The 

sxsr ° £ tajrs™? 

NAME " CONTRACTOR INDUCTING PROJEC T Southwestern O^crat^ 



' 4. 



NAME OF PROGRAM AND PUBLIC LAW UNDER WHTCw rr™™ * 

oinoer WHICH CONTRACT WAS AWARDED 

Regional Educational Laboratories Procrl™ f p. L . M . ln Ti> ,„ 

TeC^END^I^ 

.So uthwestern Cooperative Education*. Moratory Ino a.a.- m e , „„ 

- 0-upxcatxo.s 



ACC^PUSMNG ^ INSTRaMENT » 

a * ^o ne ^al natu re and objectives of the studv Th/» 

fe«ce tne effec ts of systematic variation of ’ P ;* rp08e ° f Chts 6tud y is co investi- 
classroom situations. Specifically the f SeVeral Parameters of reinforcement in 
.reward and the-' delag of reward 7 ' ** parametera of interest are the nature o| 

room. -However, ^his ^einfoLemen^is momentary T'*™* ° f reinforcem «»t in the class- 
effective incentive for either short or lone-tL^ na , ture and “X not serve as an 
here correct behaviors of individual children in f°ei l8, ‘ Perhaps a P olnt system 
b. .Instruments to he applied: ’ ' _ ? c1 ? 88 are rewarded by points and 

continued on second page.. 



See second page. 



6 ‘ COMPETE REQWRED BY , 0NE R ^PONDENT T O 

7 - %c^a. TOTAL COST or SURVEY $ _n, 000 



o 

ERIC 



b. ’ Printin° f Pla ^ ff and ° r ganizing the Survey 

c. Editing, Co^iagf Tab^atfng^nd°XhSl^^ n ^ eration ’ and Sam P le Maintenance. 
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SF-83 SUPPORTING STATEMENT FOR EXTRAMURAL RESEARCH PROJECTS 



- 2 - 



5 . 



Ce ner.l nature and obtectlve, of the se „ Hv . . continued 



these are cumulated for the daec - . . 

desired behaviors. Thus, i n this studv may be “ er motivate the performance of 

forcing appropriate behaviors will be In ^ ® 0n y e ” tl0nal mode of verbally re i n - 
as a whole accumulates points toward 8om" l * ,are • w * tb a P°^ nt system where the class 
tangible reward will be awarded d maXlmUm numb «. at which time, some 



Also, although research on delay of reward lnHir.f . 

is more effective in establishes desiredV^ 1 ? Chat lmnedia te reward 

children might work as well for delav-H d b ® hav ^ or » ifc seems reasonable that 

particularly, if the Jeujed intollll* inTOediate reward, 

the effects of delay. Thus delav in anal magnitude sufficient to overcome 

“ wen .. verbal pl.i.. 

Till? f 1 ^ ■ a*M a ^ a. _ i _ 



b * Jnstrument s to be ap p u 0 a . 



< 1 ) 



sm**; TL h edit , io - 1963 — »«» 

Pre- end poet-teet ings ere planned.’ " ettc > «nd English. (90 minutes) 



(2) Goodenough Draw-A-Man Test (10 minutes) 



'.3) 



(*) 



Lorge-Thorndike Intelligence Test (135 minutes) 



Should the tests become availahlo ... Ce ’ Princeton, New Jersey, 
this battery instead of the California Achi^ f<iW Weeks * - we wil1 use 
We have a tentative cogent from EM tn tev f roen 5. Test (item 1 above), 
to us for research purposes. A main^f * ? ak * th “ battery available 
inclusion of a listening test which ia PP ? al of thls new battery is its 
skills effort of our Laboratory Sta tes^' a PP ro Prl«« for the language 

of testing spread over the period “ . “ek ’"SJ.’TSi” “-“f, 180 »‘nute. 
administered as follows- Form n awaelc ' Thl# batter y would be 
Spring. W ®‘ FOrm B in Octobe ^ and Form A some time in the 



reactions to the^arious^ewaJd conditions* 4 F°° n t0 as8ess the children's 
of liking and disliking of rewaed r ip nl .? S * F ?5 an exam P le » expressions 
questionnaire will be 



c» Responden ts nnd\ Sampl i n f » . 



in this study sinc^it^ince^tion ^Th^ system have b een involved 

entire first-grade. beha^^ecUv s “^lulu^^ 9 “ • 

serves as a common base for studvine tha 1 curriculum. This curriculum 

condition, across classrooms and prfvl^s “Hullr ^ rloua te < 1 " £ orcement 
to assess differing teaching strategies bullt -‘" evaluation retired 




are^rimarily study. The children 

and are about evenly divided between Anelo-Am’ ^ lower " middle class background. 
This population was- selected in order tn u Can f and Spanish- Americans, 
of. youngsters- while avoiding the Droblcm r6aC * relatively disadvantaged group 
population. 8 the. problems presented by a non-English speaking 



MODULE II, SWCEL 
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c * Respondents and Sampling : - continued 

Teachers meet periodically to compare notes and make comments on curriculum 
and on teaching strategies. 

First-grade pupils will be tested for about 225 minutes if the California 
Achievement Test is employed. Approximately 405 minutes of testing time will 
be involved if the longer Cooperative Primary Test Battery is employed. These 
totals include two administrations of achievement tests. Testing on the 
achievement tests will be spread over a period of a week. At such time as 
the student preference questionnaire is developed (b(5) above), an additional 
ten minutes of student response time will become necessary. Since teachers 
will shift reward conditions about every nine weeks, children would be re- 
quired to complete this questionnaire at least three times, making about a 
30-minute total student respondent time on the preference instrument. (A 
number of teacher-made achievement tests which are part of the developed 
curriculum are not, of course, included in the total required student testing 



Since all the instruments listed above, with the exception of the preference 

«-? St . l0nna f re .’. °. f a standard variety and listed in the Buros' Mental 
jj gasurements Handbook, no copies are submitted with this clearance request. 
The preference questionnaire will be submitted separately for your review. 

Data Analysts : 



Analyses of variance and t-tests will be utilized to investigate differences 
in achievement between the various reinforcement conditions and control 
groups which are usual classroom situations. Achievement will be measured 
y (1) tests which are part of the common curriculum and (2) standardized 
achievement tests (pre- and post-testings). Inasmuch as experimental teachers 
will be assigned to various experimental situations, it will be possible to 
investigate the effects of change in children's performance (and preferences) 
as these children are exposed to varying conditions. 

a. Confidentiality : . 



To insure confidentiality of data and a valid test administration, an expert 
test administrator, trained by the Laboratory, will administer the tests listed 
above. School personnel are not entitled to results of this testing except in 
form of class averages. Respondents numbers will replace student identification 
as data is placed on magnetic tape for data analysis purposes. Test data by 
student name wild, be filed and kept for a period of about one year for purposes 
of within Laboratory research. 



PGL/ael 
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SWCEL CLASSROOM OBSERVER RATING SCHEDULE 



School; 

Nans of Observer: 

Observer Consecutive Interview Nuntoer: 
Number of Boys in Class: 



Teacher: 

Date: 

Time Period: 

Number of Girls in Class:_ 



V making or not making responses indicated. 

INSTRJCTI ONS : Record number of pupiis naking^ aM .^t,v eoinE on in classroom 
Be sure-t — ecorxi subject a«a of i^ traction ^ c ^ ) 1 ^ tes g for varmup and 
during each rating period of ‘’Chedulo. r classroom. The follcwing 

familiarization before beginning ratings in < Snowed: 
schedule for observation and rating is to.be 

First 2 minutes - Section I items T; ^t**~**. 

Second 2 minutes - Section II items. TWB. i 
Next 3 minutes - Section III items .TIME. L-7 minu^ 

Next 2 minutes - Section I items. 

S£ ISK. 1 !.* TO. n minutes. !S secmtds 

5e« 5 minutes - Section IVe. TIME: 16 minutes. 15 seconds. 

Remaining Time ^until 20 minutes elapsec) - section V. 



SUBJECT AREAS COVERED DURIN G OBSERVATION 



0-2 2-U 



Tine Pericds 
U -7 7-9 10-12 l^secs.. End 
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SECTION I 


0-£ 




. 7-9 




■XSMj 


1. Ps fidgeting in seats (restlessness, shifting 
about, etc.) * 


1 


n~ 

1 




\m~m~ 

J* 


2 9 Ps leayirg seat for non -academic reasons 
(within room or outside room) 


1 

i 


[♦ : 


n 

» 

i 






3* Ps speaking inappropriately 


i 

1 


[ + 1 


( 

» 

r 

1 ! 


a 




li. Ps looking at observer in rear of room 


j 


i 

■f* ! 


1 

i 


: * 




5. Ps interrupting other pupils directly 

(talking, poking, tapping person, etc.) 




4* j 




1 




6. Ps dropping objects and/or picking them off 
floor j reaching around chai rt: or "desk 






SS 




7 * Ps refusing teacher request (inattentive) 




- 1 
1 

*■ 


i 


w 




TOTALS 




4 

l 


L 


t * 




SECTION II 












1. Ps ignoring teacher request (not responding) 




r 




2. Ps not singing, reading, drawing, etc. 








« 1 




3« Ps not working on assigned task 




+ 




f*l 




lu Ps not holding up hand for task (e.g. "Who 

knows this answer?" Lack of participation.) 


i 


+ 


1 

j 

i 


i. 

f 


f 


5» Ps making some inappropriate disruptive 
response 




,+■ 


J 


| 


6. Ps making some response, which .indicates shy 

fearful, reluctant child (e.g. heal' turned* 1 

down, not looking at teacher) 5 




i 


i 

5 

* | 


f* 

? 

r 

1 — 
r *■ 




7. Ps daydreaming (e.g. sit tir©. very still f 

looking straight ahead) * \ 

- - r 




4- 


j 


- 




ToTAJ-S 




1 

1 +■ 





i 
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SECTION HI. 






1, Ps raising hand before speaking 

2, Ps asking question about subject content 

, 

3, Ps asking teacher for help, guidance and advice 

U. Ps asking teacher for approval ("Did I do right?”) 

5. Ps volunteering information (wanting to react to 
teacher statement or give answer) . 



i ffN V >■* ! *»’ 



6. Ps offering assistance or cooperation with fellow 

sin dent ( offer of help or encairagement) 

i ii iw^<wnn w iw ' 11 * 1 < > 1 

7. Ps reminding fellow students to conform or do .jj 

something, to accept res ponsibility j _ 

8. Ps making aggressive statements to other students i 

("You caused us to lose points." 1 

9. Ps chiding other student far wrong answer (not as j 
hostile as 8— might just be "ooh," or "oh, heckl).; 

iinirrrr-T 

11. Ps questioning teacher about group goal or reward Jj 

ii imnt‘1'* | im i ^ ‘iitTri*! 

12. Ps mentioning group reward as positive goal - a 

positive statement about working for or toward 
group reward without- hostile connotations for 
student who "blew it." as in 8 above 




10. Ps showing affection far teacher 

> <rn » T~* " M * w “*** % * nmn * 



MKIMt 



i tv \ -.'fY*r* * ** *< * 

5 \ 

) f 

t s 





T»TA<~ S 



l 

r 

-4* 

I 

I 



~'~V 



SECTION IV. 



COUNT THE NUMBER OF CHILDREN SHOWING GROSS HEAD TURNING MOVEMENTS 
AWAY FROM TEACHER OR APPROPRIATE OBJECT OF ATTENTION DURING NEXT 
FIFTEEN SECONDS . 



REOOR) NUMBER IN BLANK. 

Total c 
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SECTION IVa. 

NAME OF TEACHER 

RECORD THE NUMBER OF TIMES THE TEACHER MAKES EACH OF THE RESPONSE-TYPES BELCW. 



1. Learner Supportive Statements 




2. Accepting or Clarifying Statements 




3. Problem Structuring Statements 


\ ' ' r ' 

\ , 


U. Neutral Statements 


• 


5. Directive Statements 




6. Reproving, Disapproving, Disparaging Statements 




7* Teacher-Supportive Statements 





O 
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SECTION V . Classroom Atmosphere Ratings, 
NAME OF TEACHER 



CIRCLE APPROPRIATE RESPONSE NUMBER FOR EACH DIMENSION OR ITEM BELOW. ITEMS REFER 
TO CLASS AS A WHOIE. 



1. ALERTNESS (ATTENTIVE, WAKEFUL, RECEPTIVE) 


li 


2 


3 


U 


5 


6 


7 


8 


9 I 


2. INDUSTRY , CONSTRUCTIVELY HJSY, ACTIVITY 


1 


2 


3 


U 


5 


6 


7 


8 


9 I 


3. ENTHUSIASM OF CLASS, INTEREST 


1 


2 


3 


u 


5 


6 


7 


8 


9 I 


U. CURIOSITY, INFORMATION -SEEKING 


1 


2 


3 


u 


5 


6 


7 


8 


9 I 


5. AMBITIOUSNESS EAGERNESS TO RESPOND AND 
WILLINGNESS TO RECITE 


1 


2 


3 


u 


5 


6 


7 


8 


9 I 


6. APPEARANCE AND BEARING OF PUPILS NEAT 
CLEAN, PERSONAL GROOMING 


1 


? 


3 


u 


5 


6 


7 


8 


9 I 


7. QUARRELSOME , UNFRIENDLY ATMOSPHERE 
AMONG STUDENTS 


1 


2? 


3 


u 


5 


6 


7 


8 


9 I 


8. DEGREE OF ACCEPTANCE OF MISTAKES OF PUPIL 
BY OTHER PUPILS 


1 


2 


3 


u 


5 


6 


7 


8 


9 


9. DEGREE OF TENSENESS OR ANXIOUS ATTENTIVE- 
NESS , OR FEAR DISPIAYED BY STUDENTS 


1 


2 


3 


u 


5 


6 


7 


8 


9 


10. DEGREE OF COURTESY PATIENCE AM) CONSIDERATE- 
NESS DISPIAYED AMONG STUDENTS 


1 


2 


3 


u 


5 


6 


7 


8 


9 


11. DEGREE OF SPONTANEITY, FREE EXPRESSION 


1 


2 


3 


u 


5 


6 


77 


8 


9 


12. HOSTILITY INDICATED TOWARD TEACHER 


1 


2 


3 


u 


5 


6 


7 


8 


9 


13. HOSTILITY AMONG FELLOW STUDENTS 


1 


2 


3 


u 


5 


6 


7 


8 


9 


lh. DEGREE OF COOPERATIVENESS WILLINGNESS TO 
SHARE OR GIVE ASSISTANCE BETWEEN PUPILS 


/ 


A 


3 


H 


r t 


7 


2 


7 


15. AMOUNT OF INTERACTION BETWEEN PUPIIS 


1 


7- 


3 






0 


7 


2 


7 


16. AMOUNT OF STUDENT-INITIATED ACTIVITY 


\ 


7- 


2> 


4 




G 


7 


l 


7 


17. AMOUNT OF INTERACTION BETWEEN TEACHER & PUPIIS 


1 


9- 


3 


H- 




■ 


7 


Z 


7 


18. COOPERATION BETWEEN PUPILS AND TEACHER PUPILS 
HELPING TEACHER WITH TASKS 


1 


% 


3 


H- 




b 


7 


2 


7 


19. GUIDANCE-SEEKING BY PUPILS OF TEACHER 


) 


3 - 


3 






G 


7 


7 


7 


20. GUIDANCE-SEEKING BY PUPIIS OF OTHER PUPIIS 

r 


1 


7- 


3 


f 


< 


b 


7 




7 



LD\/J /WJgRAGg* /-fifrH ! 



DK 



DK 



DK 

DK 

DK 

DK 

OK 

K 

0 < 

0 V 



K 






25 
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21. APPRDVAI^SEKKTNG BY PUPILS OF TEACHER 


} X Z 


Lf b 


13 7 


ok 


22. APPROVAL-SEEKING BY PUPILS OF OTOE R PUPIIS 


) x 3 


r u 


7 2 9 


H 


23 . TEACHER DOMINANCE IN CIASSROOM 


/ ^ 3 


^ r i* 


7 ? 7 


K 


2b. TEACHER COURTESY TOWARD STUDENTS 


/ «*-> 3 


Hr JT ^ 


7 2 / 




25. CLASSROOM CONTROL AND ORDERLINESS 


1 > 3 


if- iT 0 


72/ 




26. IRRELEVANT TALKING AMONG PUPILS 


/ > T> 


jr 


7%7 




27* PRESSURES TOWARD GROUP CONFORMITY 
AMONG PUPILS 


) X 3 


h- <r b 


7 3 ? 


Af 


26. DAYDH5AMING AMONG PUPILS 


1 X ? 


f C b 


■7 2? 


J>lj 


29. DEGREE OF COMPETITIVENESS BETWEEN PUPIIS 


1X3 


t r> 


7 2 7 


bit 


30. TEACHER USE OF DISCIPLINE OR REFERENCE TO 
DISCIPLINARY MEASURES 


/ 0-3 


v 1 & 


7 21 


J)l( 


31. IEARNER-SUPPORTIVE ATMOSPHERE 


' 1 X 3 


^ .r b? 


7 ? f 


H 


32. ACCEPT ANT OUTLOOK ("HELP IEARNER GAIN INSIGHT"' 


j X 3 




7 3 y 




33. PROBIEM-STRU CTU RING ACTIVITY BY TEACHER 


1 


trii 


ttT 


44 


3b o NEUTRAL STATEMENTS -ADMINISTRATIVE FACILITATICN 


l 1 3 


y. r k 


~TTT~ 


44 


35. DIRECTIVE STATEMENTS -PUPIL TO ADAPT TO TEACHFJL 


i 7 - -3 


c/ C* Cj 


7 2 1 


M 


^ RF.PRrrJTMO DT5? A 'DPRnVTMTl TVTQPA P hClTKY). A'PMnQDtnTDU 


1 QL ._•? 


s' b 


TTT 


Li 


jyj • iturnv/v uiuAi rrtXJVxiKt u± o rA Jrtffjrl jfj , , A,l MUp rn t*. flu 

37. TEACHER-SUPPORTIVE STATEMENTS (TEACHER REFERS 
TO SELF) 


— ) v 

1 


4 ^ ^ 


■7 2 1 


K 



DK * Don't knew} indeteminate; not observed. 





SOUTHWESTERN COOPERATIVE EDUCATIONAL LABORATORY 
STUDENT QUESTIONNAIRE 



Name of Pupil: . 5ex: 

Name of School: • G rade Age: 

Name of Pueblo (or Community) Where Pupil Lives: 1 

Name of First Grade Teacher: 

1. Do you think you will finish high school--12 years of school? (Paraphrase if 
necessary.) (Circle one below.) 

YES NO DON'T KNOW 

2. "I would like to give you a piece of candy. I have two sizes but I don't have enough 
of these (indicating the bigger one) with me today. So you can either have this one 
(the smaller one) right now, today, or, if you want to, you can wait for this one 
(indicating the larger one) tomorrow." (Repeat instructions in paraphrase to insure 
clarity and display both reinforcements carefully. Be sure to stress that getting 

the (smaller) candy today precludes getting the (larger) one tomorrow, and vice versa.) 

Okay, which one do you want? (Circle one:) Smaller Qn e Today Larger One Tomorrow 

3. "I am going to ask you some other questions. These questions are different from other 
questions you are asked in school . There are no right or wrong answers to these^ 
questions. Just listen to each question and then answer either "yes" or "no". 

(Example: "Do. you like to play ball?" (Get an answer and proceed.) "Remember, listen 

carefully to each question and answer it either "yes" or "no". If you don't understand 
a question, please ask me about it." 

(Indicate Y for "Yes" or N for "No" for each question below.) 

(1) Do you like to take toys to school and show them to the children? 

(2) Do you like to tell the other children about some fun things you did? 

t 

(3) Do you like it when the teacher asks you something in class? 

(4) Are you as smart as the other kids in your class? 

(5) Do you ever get up in front of the class and talk to the children? 

(6) Do you ever get nervous or afraid in school? 

("Why" might be interesting to ask here to determine nature of fear. 

This .would also break up any routine established thus far.) 

(7) Do the other kids know more answers than you? 

(8) Is school hard? 



2 . 



(9) Is School fun? 

(10) Are you ever scared when the teacher asks you a question in school? 

(11) Do you ever cry in school? (If yss, ask why.) - — 

(12) Do you think you will pass to the second grade? 

(13) Do you like school? 

( 14 ) "Do you know what a test is?" That's when the teacher tries to find 

out how much you know. Do you like to take a test? 

4. "Okay, let's do some other things now. Here are some circles. Each circle stands 
for some person. Choose the circle that stands for you. Which one are you? 

(Point to the row below and have child point to the one that stands for him. 

> Circle that circle!) 

ooooo 

"Allright, here is Another group of circles. Which circle is you?" 

0 

0 

0 

0 

0 

5. . "Here are some more circles. This one (pointing to the dark circle) stands 
for your father . If this is your father, which one is you? (Point to row 
of circles . ) '* 

0 0 0 0 0 

"Allright, here is another group of circles. This one (the dark one) is your 
father , which one is you?" 

0 

0 

0 

0 

0 
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6. "Okay, now look at these circles. In this group of circles, the dark one stands for 
your mother . If this (pointing) is your mother, which one is you? Which circle 
is you?” 

0 0 0 0 9 

Now, this one (pointing to the dark one) is your mother . Which one is you? 

0 

0 

0 . 

0 

0 

7. Do you think you are more like your father or more like your mother? 

(Circle one.) 

FATHER MOTHER ABOUT THE SAME I DON'T KNOW 

8. "Let's pretend there is a magic man who can change you into anything you want to be. 
What would you want to be? Please tell me in one word. (Record word in space below.) 



9. Would you rather have a penny today or wait until tomorrow for five cents? 
(Circle answer below.) 

One Cent Five Cents . Don't know 

10. Would you rather have 25$ right now, or wait until next week for $1.00? 

25$ $1.00 Don't know 

11. Now, tell me. Would you rather wait for a real big gift much later or would you 
rather have a smaller gift now? 

Big gift later Smaller gift now Don't know 

12. "I have something in mind. I am closing my eyes and thinking of it... it is 
something you might agree with or' that you might disagree with. . .you might 
disagree with what I'm thinking or you might agree with it... 

If you agree , say YES; if you disagree, say NO. Now I'm thinking of it 
(closing your eyes). (Record answer below.) 

YES NO 



O 
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13. "Now, I have something else in mind. I am closing my eyes and concentrating and 
thinking of it... it is something that you might agree with or that you might 
disagree with... you might disagree with what I'm thinking of or you might agree 
with it.... Mow I'm concentrating on it (closing eyes). If you disagree, sav NO: 
if you agree, say YES. 

NO YES 

14. What do you really think you will be when you grow- up ? 

15. "Listen to the following questions and answer either YES or NO." 

(1) Do you believe you can be whatever you want to be when, you grow up? 

(2) If another kid was going to hit you, could you do something about it? 

(3) Can you sometimes make people do what you want them to do? 

(4) When somebody gets mad at you, can you do something to make him your friend 

again? 

(5) Will people usually let you do what you want if you ask them? 

(6) Ib there a good fairy who can make good things happen to you? 

(7) Is there a bad fairy that can make bad things happen to you? 

(8) When you want to do something, do you usually make up your own mind or do 
you ask somebody first? (Circle one.) 

HAKE UP OWN MIND ASK SOMEBODY FIRST 
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TASK FORCE II 

Module C 

Module C is concerned with field tryouts of the USOE-UCLA Oral Language 
Materials for Culturally-Diverse Children. The first field tryout of these 
materials is now underway for both Spanish-American and Navajo first grade 
students. The Spanish-American tryout is taking place in schools in Stayer, 

Texas; San Miguel, New Mexico; El Paso, Texas; and Douglas, Arizona. The 
Navajo Field Trial is taking place at Sanders, Arizona. A general statement 
of the research is contained in the attached Appendix C. In addition to the 
procedures cited here, a vigilance-reinforcement-performance experiment has 
been built into the framework of the USOE-UCLA materials for the Navajo Field 
Trial. 

Initially, it should be stated that the USOE-UCLA materials were modi- 
fied during the summer on the basis of study of their application in experi- 
mental Head Start classes conducted by the Laboratory. The revised lessons 
are being field-tested, although the number of revised lessons for Navajo 
is less than the number for Spanish-American. In the Spanish-American field 
tryout, approximately 200 children are being exposed to the oral language 
materials. A control group of children in the same schools, or in similar 
schools, are receiving usual instruction. Tests given as pretests at the 
beginning of school in September are the Ott- Jameson Oral Language Proficiency 
Test and the SWCEL Oral Language Capacity Test. A special achievement test over 
the USOE-UCLA Lessons has been assembled by Dr. Martin. These tests will be re- 
peated as post-tests. It is expected that oral language performance of students 
receiving the Laboratory program will exceed that of students not receiving the 
Laboratory program. 
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Module C- continued 

An additional phase of this research involves the evaluacion and rewriting 
of the USOE-UCLA materials beyond lesson number 40. Teachers now participating 
in the experiment received a week- long training session prior to teaching in 
the program. They also received training on lesson revision functions, and such 
efforts are being coordinated by Mrs. Ida Carrillo of SWCEL. 

The Navajo Field Trial is now underway at Sanders, Arizona, utilizing 
only 20 lessons. Robert Reeback and Robert Ebert have designed vigilance study 
within the scope of the lesson presentation to assess the effects of vigilance 
(being aware of certain cues given by the teacher and having pupils repeat 
these) and certain reinforcement procedures on learning of the materials. A 
two-week training period was provided an experienced teacher of Navajo children 
in the experimental procedure and the teaching of the USOE-UCLA materials. 

Practice lessons in-house with three Indian children from CAffoncito were video 
taped by Media Lab staff in an observation classroom prepared by the Media Lab, 
under the direction of Mr. Guy Watson. In addition, a male teacher's aide from 
Sanders was trained by Media Lab staff to operate video equipment. He was also 
trained by Mr. Ebert to teach the. vigilance game to children and to perform 
several tasks necessary for the experiment. Video tapes are being made of all 
field sessions to assess responses of pupils. It is hypothesized that the ex- 
perimental procedures will result in greater attention by students and that this 
attention will, in, turn, contribute to increased levels of performance, as 
children move from the baseline condition to vigilance, and vigilance with reinforce 



ment . 
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Module C- continued 

Difficulties with the oral language materials field trials are those which 
develop when investigators are distant from the field tryout sites. Less in- 
formation and reduced response times to crises and restricted opportunities for 
making modifications are disadvantages of conducting research at distant sites. 
Equipment problems and staffing problems have developed, particularly in the 
Sanders experiment, where a video tape operator had to be trained. These pro- 
blems have indicated the need for additional Media Laboratory specialists to 
conduct the field work of the Laboratory, rather than resorting to the training 
of outside people. Also, field research todate has pointed up the need for 
special research equipment, notably Event Recorders. 

Current concerns in this module are to assess the worth and determine the 
future of the USOE-UCLA materials. It is expected that the field trials now 
underway will yield useful information in this regard. An Inter-Disciplinary 
Review and Rewrite Group has been established within the Laboratory to determine 
ways in which the USOE-UCLA materials can be modified and supplemented, both in 
content and in mode of presentation. In the final analysis this Group will 
determine future applications of these materials, whether to keep or discard, if 
to keep, in what form with what changes, and whether these materials will form 
the base for a reading program. Data being collected in the field now, plus 
the evaluation of video taped sessions of the materials in the Navajo Field Trial, 

will contribute to the decision by the Inter-Disciplinary Review and Rewrite 
Group . 

On-going activities of the Task Force include preparation of the resume 
of all work todate on the USOE-UCLA Lessons, both in-house and at Rough Rock. 

Mrs. Randall is doing this resume. Mr. Ebert is continuing to write up the 
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Module C-continued 

Navajo Field Trial. Mr. Reeback is continuing to plan the next stage of 
activities with the USOE-UCLA Lessens. Activities, during the next month will 
include a rewrite procedure for the Wilson Lessons based on the Navajo Field 
Trial. This procedure will be supervised by Mr. Reeback and involve the con- 
tributions of Dr. Mavis Martin, Dr. Henry Burger, Mr. Guy Watson, Mr. Richard 
Thiel, Mrs. Ida Carrillo, and others. There will also be site visits to the 
Sanders class. Also, an experimental form of a test of oral English proficiency 
for use with Navajo elementary school children is being developed. 

Much of the Task Force activity in the next month will be devoted to 
preparation of the next stage of experimentation. To sketch this, it is 
anticipated that four Head Start classes of ten children each will undergo 
training with the USOE-UCLA Lessons, that each of these four classes will represent 
an experimental condition; viz., (1) a replication of the Sanders Trial involving 
alternation of the vigilance and reinforcement conditions; (2) an evaluation 
of the effectiveness of group and individual reinforcement procedures appli- 
cable to Navajo children; (3) the elaboration of an increased pool of possible 
reinforcements; and (4) the institution of a contingency of reinforcement upon 
performance on lesson post-testing as well as upon performance in the vigilance 
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Herbert S. Conrad, Chairman 
Internal Clearance Committee. 



\4 






•U6JCCT. 



Clearance of 3 data -gathering instruments designed for u-'-e in the 
study entitled "FIRST FIELD TRYOUT OF ORAL LANGUAGE PROGRAM FO^ 

culturauy-diverse children" - , su b-s t udv^ i;r,^r 

II, Culturally Relevant Learning Materials in the Language Arts " 
Southwestern Cooperative Educational Laboratory, Inc, , Albuquerque 
New Mexico (Contract No, 0EC-4-7-062827-3078) . 4 9, 



The purpose of the study is "to evaluate the first field tryout of a 
language arts program developed at UCLA (University of California 

j T ^ iS pr ° eram is bascd u P° n * linguistic foundation! 
and is designed for culturally diverse preschool and first-grade children 

aSd N-« Sinal lessons have been modified for use with Spanish -American 
and N»vajo youngsters by the (Southwestern) Laboratory, and the 
approximately two-month -long program will be tried out in (four) 

llltflt' tltl* 16 £,2 tb ^®-state area (Texas, New Mexico, and Arizona). 
Briefly stated, children exposed to the. program will be compared with 

a group of first-grade children who did not receive the program," 



Three data -gathering instruments have been submitted for clearance 
prior to use in the abovenamed project: 



l * Ott-Jameso n Test of Spoken English, Part It Or al English 
Proficiency , 

This is an interview-test of pronunciation of various 
phonemes offering difficulties for Spanish -American children. 

2. Oral English Capacity Test . 

This test is designed as an interview with the prospective 
■pupil. The test will consist of such questions as "What is 
your name?" "Please count to ten," "What did you eat today?" 

Approximately 200 (children) will be in the field tryout of the UCLA 
materials; that is, they will be taught with the special oral language 
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SOUTHWESTERN 

COOPERATIVE EDUCATIONAL LABORATORY, INC. 

Arizona • Now Mexico • Oklahoma • Wbst Texas 
J» G. STRATTON, President 

i . PAUL V. PETTY, Director 



PboM: 277-5221 



H7 Richmond, N.E. 



Albuquerque, N.M.' 87106 
'September 11, 1967 







Mr. Adrian Parameter 
Program Coordinator 



Division of Educational Laboratories 
U. S. Office of Education 
400 Maryland, S.W. 

Washington, D. C. , 20202 



Dear Mr- Parameter: 

Gather ing n in8trument8 °” X Z'lllt * for " Revie " of Data 

with the evaluation of a field t^t^f "^1 b< \ U8ed in conjunction 
language program being developed^/ thil 

are supplied on the attached sheet. oratory. Additional detaila 



Thank you for your consideration. 



PGL/ael 

Enel: 4 (in copies of 6) 

cc* Dr. Herbert S. Conrad 
Dr. Paul Petty 
Dr. Stanley Caplan 
Mr-. Robert T. Reeback 



Sincerely, 

Research Coordinator 
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SF-83 SUPPORTING STATEMENT FOR EXTRAMURAL RESEARCH PROJECTS 



.Project Title ; Southwestern Cooperative Educational Laboratory, Module II, Culturally 

Relevant Learning Materials in the Language Arts. Mr. Robert T. Reeback, 
Principal Investigator. Study: First Field. Tryout of Oral Language 

Program for Culturally-Diverae Children. 

. 1. NAME OF CONTRACTOR CONDUCTING PROJEC T Southwestern Cooperative 

Educational Laboratory, Inc, , Albuquerque, New Mexico 

2. OE CONTRACT NUMBE R OEC -4-7 -062827-3078 

Dated: From 3/1/67 T o 5/31/68 

3. NAME OF PROGRAM AND PUBLIC LAW UNDER WHICH CONTRACT WAS AWARDED 

Regional Educational Laboratories Program. , P. L. 89-10» Title IV 

4. NAME OF COMMITTEE (PANEL, FIELD READERS, OR OTHER GROUPS) THAT 

RECOMMENDED APPROVAL FOR SUPPORT OF THIS RESEARCH PROJECT 

Southwestern Cooperative Educational Laboratory, Inc., Albuquerque. New Mexico 

a. THIS PROJECT HAS BEEN REVIEWED ‘AND kP PROVED WITH QUALIFICATIONS 
BY THE BUREAU STATISTICAL REVIEW PANEL, ON (Date) 

5. EXPLAIN THE RELATIONSHIP OF THE DATA GATHERING INSTRUMENT IN 

ACCOMPLISHING THE OBJECTIVES OF THE PROJECT 

a. General nature and objectives of the study: xhe purpose a£ the study is to 
evaluate the first field tryout of a language arts program developed at UCLA. 

•. This program is based upon a linguistic foundation and is designed for culturally 
diverse preschool and first grade children; The original lessons have been 
modified for use with Spanish- American and Navajo youngsters by this Laboratory 
and ‘the approximately two-month long program will be tried out in spected schools 
in a three-state ^rea. Briefly stated, children exposed to the program will be 
compared with a group of first-grade children who did not receive the program. ; 

b. Instruments to be applied: 

(1) 'Ott- Jameson Test of Spoken English’, Part I: Oral English Proficiency" 

(15 minutes) » 

(2) Oral English Capacity Test (15 minutes) 



6 . 
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(3) Beacon School Teacher Reaction Form (15 min.utes) 

SEE ATTACHED SHEET FOR INFORMATION UNDER NO. 5. 

ESTIMATED NUMBER OF MANHOURS REQUIRED BY ONE RESPONDENT TO 
COMPLETE QUESTIONNAIRE Pupil - 30 minutes (15 minutes on each of two testsl 



Teacher- 

ESTIMATED TOTAL COST OF SURVEY $ 
INCLUDING: 



15 minutes o 



500.00 



>n each lesson. presented. Forty 
lessons comprise present study. 



O 

ERIC 



b. 

c. 



Costs of Planning and Organizing the Survey 



Printing, Mailing (including Follow-up) or Enumeration, and Sample Maintenance 
Editing,' Coding, Tabulating and Publishing 
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Re spondents Sampling and Locale ; Four schools with predominantly 
Spanish-American cnroliment were selected in a three-state region 

student a ° V? ^ material8 Spanish-American firstgrade 

SS El S s e o 8C J° 8 "J i° Ca f ed! Smyer ’ Texas i Sa " Miguel, New 

s^iHh u ? an ’ chei ^ of 

mix. Fi^st erld en * l '; ely Spa " iah «nd schools that have a Spanish-Anglo 
class. e s u ents w 1 be predominantly from lower socioeconomic 

the r u^ a msJ y ■»? St ^ enta wil1 be Evolved in the field tryout of 
the UCLA materials; that is, they will be taught with the snecial 

ZlVrr*; prOSram • Seven < 7 ) children with Spanish surnames will 

ihildM? ld ?li r I Wn fr0m e3Ch ° f the elght clas8r °°ms (N=56) . These 
tS assess W oral la Pr6 ' and Post-tested on the two instruments intended 
Eneliah ^ 8 ? ®® P>; of ^ency, the Ott-Jameson Test of Spoken 

55“\ ^ ° ral En8llsh Ca P acit y Test. These tests will be 

ministered by a trained interviewer who has had previous experience 
in using these tests with culturally-diverse children. The tesUng 
sessions, will be tape-recorded so that pupils' responses mav be 
analyzed along various linguisitic dimensions. Total testi^time 

?2 !??? ° f ?Ki 56 k Chlldren wiU not be in excess of thirty mWes 
and wiH probably be much shorter. A control group of 56 Children * 

will be selected from other classrooms in the same school, or in 
some cases, from students in a similarly-constituted school nearby. 

This control group of 56 children will likewise be tested on the two 
instruments described above and their responses tape-recorded for 

oral anal y sis - i® expected that students receiving the 

oral language program designed by the Laboratory will show greater 
oral language proficiency than control students. 8 

Teachers in the eight (8) .experimental classrooms will periodically 
t et ? n C e Teacher Rea ‘tion Form, normally after completing each 

forty^essons^which wfll 00 " 6 ?' After com Pletion of these 

rorty lessons, which will complete the study described above, additional 

."“Hart If e h rs ted . by t ? e te ‘ ChetS - 

that -l ar J of the UCLA materials, have not been adapted for use so 
e teachers comments will be important in the revision work 
planned for lessons beyond lesson number 40. 

In some instances, the schools in this study have a testing 

SIlffornTi^ K- d6S standardi2ad achievement tests, notably, the 
California. Achievement Test. Where annual testing is found to exist 

experimental cla SUCh reSUl ^ S t0 com P are student performance in the * 

oH a al i 1 r r00mS , a8ainSt the lan8uage achievement performance 

of students in the previous year. Although such a procedure has 

l ” liwitations * we will be using whatever test scores are 

oral 1 ? 1 * 1 ^ t0 US that haVe 8 ° me bearln 8 on the effectiveness of our 
oral language program. No achievement testing will be introduced 
however, by the Laboratory in connection with the study described 
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5* d. Other information : Plans are underway at this time for the video 

taping of some of the UCLA materials. An expert teacher will be 
used to record selected lessons to investigate the feasibility of 
such a procedure. This procedure would involve finding an experi- 
mental (Spanish- Anglo mix) classroom in the Albuquerque area 
and performing the study as described in other area schools. 

A Navajo class will probably also be chosen in order to evaluate 
the effectiveness of the materials for Indian first graders. Only 
ten lessons will be employed, however. Procedures like those des- 
cribed above will be adhered to. 

C onfidentiality : To insure confidentiality of data and a valid teat 

administration, an expert test administrator has been trained by 
the Laboratory. Test administration will be taped and ratings made 
by linguistic and reading experts. As part of tests, pupil is 
asked to state his/her name. Teachers will not be given access to 
test results. Evaluation o£ group performance, not individual 
performance, will be made. All student information will be for 
within Laboratory use only. Student records (tapes) will be main- 
tained for at least a year. 
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TASK FORCE II - continued 

Nodule D n ^ 

This module is concerned with entry skill development, or specifically, 
with speech elicitation procedures. . During August ,’ prior to the beginning 
of school, mother questionnaires and child entry skills tests were adminis- 
tered to 70 families (Spanish-American, Anglo-American and Nava jo- American') 
Children were assigned, ten each, to seven local classrooms. In three 

i 

classes, thirty-minute video tapes were taken on days 1, 2, 3, 6, and 10. 

In all classes, teachers filled out ratings of children in their classrooms 
on days 3, 10, and 25. Ratings represented various aspects of classroom 
behavior relating to attentiveness, responsiveness, listening and verbal 
skills. The children in the study above will be followed through school. 

Two reliability studies were undertaken. Two scorers rated video 
tapes and scored children on a list of '25 behaviors. The procedure proved 
much too cumbersome, although observer reliability appeared to be high over 
twelve behaviors, two children, for two days: The absolute necessity of 

acquiring event recorders became dramatically apparent. On the basis of 
the work to this point, an Observer's Manual is being assembled, in cooperation 
with the Media Laboratory, replete with illustrations and text. The second 
reliability check was made over teacher ratings. Reliability (inter-item 
consistency) was very low, with the need for much greater teacher training 
being quite obvious. 

Considerable effort has been made in the direction of a Teacher Training 
Program in Speech Elicitation. Several rewrites and many committee dis- 
cussions have taken place. Specifications have recently been rewritten to 
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Module D - continued 

allow for bidding on a piecemeal basis. Submission to bidders will probably 
take place by November 10th. The real importance of this program is that 
the Teacher Training Program in Speech Elicitation is a general program 
which can precede and accompany any kind of language instruction. 

The major developments and outcomes of activities in this module are as 
follows: 

(1) The groundwork has been laid for a behavior- scoring system by 
which an observer with an event recorder can compile a profile 
of several children in a classroom or from video tape in a very 
short time. The profile would provide information on attending 
behavior, class participation, etc., which would serve as a 
criterion variable in a variety of classroom studies where the 
effectiveness of teaching practices and materials is to be assessed 

(2) The Teacher Training Program in Speech Elicitation has been 
specified and detailed for piecemeal bidding by contractors. 

An essential part of the writeup is that a preliminary "prove-out" 
must be undertaken by each contractor; that is, the materials 
developed must be submitted to field application. The detailed 
specifications are found in Appendix D, which can be obtained 
from Mr. Reeback. This program w,ill form the basis for developing 
teacher competencies in language teaching, notably, the USOE-UCLA 
materials now under investigation in Module C. 



(3) On the basis of staff meetings originating in the Plans, Review 
and Evaluation Panel and on the advice of consultants, priorities 
have been established. Low priorities exist for further work with 
entry skill questionnaires and teacher rating forms. The Mother 
and Child Questionnaires are being given a large-scale tryout in 
Module A this Fall, and it is expected that subsequent work on 
these instruments will be the responsibility of Malcolm Garber 
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Module D - continued 

and Paul Liberty. Consolidation has also taken place within the 
Laboratory in regard to the development of the teacher entry-6kill 
rating form, with Module. B pursuing the development of a simi- 
lar instrument in their emphasis on the development of classroom 
management procedures. Otherwise, "entry skills" activicy is 
being incorporated into Module C activities. A notable example 
of this is occurring in the Navajo Field Trial of USOE-UCLA 
materials, where an experiment in classroom manipulation of attend- 
ing (an entry skill) behavior, is being carried out. 

A DYNAMIC ORGANIZATION 

From the foregoing, it can be seen that some reorganization, shifting, 
and refocusing is taking place within the Laboratory. A Task Force structure 
that roughly allowed for cultural-psychological and curriculum development 
groupings was adopted. In some ways, this structure is already becoming out- 
dated what with teaching training procedures and classroom management coming 
close together. Although the old modular structure still lingers in the thinking 
of the staff, current thinking favors small i^dber- disciplinary task groups. The 
Two- Task- Force structure in no way represents, a dichotomy of interest or pro- 
fessional groups. Actually, considerable fluidity exists across Task Forces 
with staff members, as necessary, working to meet the demands of particular, tasks. 
The operational structure of the Laboratory may, therefore, be better described 
as a Task Group structure than a Task Force structure. A representative of 

this is seen in, the recent formation of a group to study, evaluate, and as,sess 

! 

the future of the USOE-UCLA materials. . This group, called the Inter-Disciplinary 
Oral Language Materials Review and Rewrite Group, includes a sociologist, anthro- 
pologist, linguist, media specialist, and reading specialist. Other individuals 
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A DYNAMIC ORGANIZATION - continued 

are available on call. Maximum utilization of manpower is accomplished in 
this way and inter-disciplinary cooperation is enhanced. 

In addition to the full utilization of available professionals within 
the Laboratory, several other reasons exist for adopting a task approach in 
organizational operation. One of these is the presence of a relatively new 
staff. Program will inevitably be modified according to the competencies of 
these individuals. Although the primary focus of the Laboratory remains the 
same, that of developing culturally- relevant materials in the language arts 
for culturally- diverse groups, particularly Indian and Spanish- American, ad- 
justments and accommodations to take advantage of professional competencies 
will occur. Secondly, it may be found, after a period of time, that overlap 
of activities may be developing or approaching. A task-oriented approach in 
organization, which also provides for a directive body, permits readjustment 
to changing program needs. 

The organizational vehicle in the Laboratory responsible for the review, 
evaluation, and directive function is a newly- formed body called the Plans, 

Review and Evaluation Panel. This body is charged with making program and 
policy recommendations to the Director. It is the organ which evaluates on-going 
programs, determines their worth and priority, and recommends continuance or 
discontinuance, and specifies the levels of resources to be committed to 
operations. This body, is, thus, the direction-giving and quality-control body 
in the organization; it is the body that is continually responsive to the pro- 
gram needs and program development of the Laboratory. In cooperation with the 
Director, the Plans, Review and Evaluation Panel is designed to insure the dynamic 
quality of SWCEL. 
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